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Abstract 
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CS . Basic relations for the mean length and algorithmic entropy are 

obtained by solving a new extremal problem. Using this extremal 



'if^ ■ problem, they are obtained in a most simple and general way. The 

length and entropy are considered as two players of a new type of a 
game, in which we follow the scheme of our previous work on thermo- 
dynamic characteristics in quantum and classical approaches. 

• i— I ' 

: 1 Introduction 

Algorithmic information theory (AIT) is an important and actively studied 
domain of computer science (see, e.g., interesting results and numerous ref- 
erences in [U El ini [m [12] )■ AIT can be interpreted in terms of statistical 
physics (SP) (see [H [121 [13] and references therein). Let us introduce the 
corresponding notions from AIT and SP. 

1. The set of all AIT programs corresponds to the set of energy eigenvec- 
tors from SP. 

2. The length of an AIT program corresponds to the energy eigenvalue 
E'fc from SP. (Here and further > 1.) 
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We denote by the probability that the length of the program is equal 
to ik, i-e. Pk = = ^k)- Next, we introduce the notions of the mean length 
L (of programs) and of the entropy 5": 

L = J2Pkh, ^ = -J]PfclogP,. (1.1) 

k k 

The connection between L and S we interpret in terms of game theory. The 
necessity of the game theory approach can be explained in the following way. 
The notion of Gibbs ensemble is introduced in AIT using an analogy with 
the second law of thermodynamics: 

Gibbs ensemble maximizes entropy on the set of programs, where the 
values {Ik} and L are fixed. 

So, the problem of a conditional extremum appears. But the correspond- 
ing equation for the Lagrange multiplier is transcendental and very compli- 
cated. Therefore, another argumentation is needed to find the basic Gibbs 
formulas. This problem exists also for the SP case (see |3l Ch.l, section 
1] and [H Ch.3, section 28]). In the present note we use our approach the 
extremal SP problem [3 El El [10] to treat also to the corresponding AIT 
problem. Namely, we fix the Lagrange multiplier P = 1/kT. That is, we fix 
the AIT analogue T of the temperature from SP and introduce the compro- 
mise function F = —fSL + S. Then the mean length L and the entropy S are 
two players of a game and the compromise result is the extremum point of 
the F. Finally, we note, that the AIT analogue of temperature was discussed 
by K.Tadaki [12]. He proved the following assertion: 

If the temperature is a computable positive number bounded by 1, it can 
be interpreted as the compression rate in the AIT analogue of thermodynamic 
theory. 

2 Connection between length and entropy, 
a game theoretical point of view 

Let the lengths ik of the programs be fixed. Consider the mean length L and 
the entropy S, which are given in fll.ip . Note that Ylk^k = 1- Hence, Pk 
can be represented in the form Pk = Pk/Z, where Z = 'Yl,kPk- Our aim is to 
find the probabilities Pk- For that purpose we consider the function 

F = \L + S, (2.1) 
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where A = —(3 = —1/kT. 

Fundamental Principle. The function F defines a game between the 
mean length L and the entropy S . 

To find the stationary point of F we calculate 

dF / °° \ °° 

— = X[i,/Z -J2^kPk/Z') - {logp,)/Z + J2Pk^ogp,/Z\ (2.2) 

k=i 



k=l 



It follows from f l2.2p that the point 

Pk = e^'\ 



= 1,2, 



(2.3) 



is a stationary point. Moreover, the stationary point is unique up to a scalar 
multiple. Without loss of generality this multiple can be fixed as in (12. 3p . 
By direct calculation we get in the stationary point (12. 3p the equalities 



d^F 
dpi 



-Zk/{pkZ^) < 0, Zk := y^PjS 



d^F 
dpkdpj 



1/Z'>0, j^k. 



Relations (12. 4p imply the following assertion. 



(2.4) 



Corollary 2.1 The stationary point (12. 3 P is a maximum point of the func- 
tion F . 



Proof. We shall use the following result (see [6l Ch.7, Problem 7]): 

af{h) - hf{a) 



det 



ri a a 
b r2 a 
b b 



b b b 



a 
a 
a 



a — b 



(2.5) 



where 

f{x) = (ri - x)(r2 - x)...(r„ - x). 
In the case that a = b we have 



(2.6) 



det 



Ti a a 
a r2 a 
a a 

aba 



a 
a 
a 



-af\a) + f{a). 



(2.7) 
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Using fl2.4l) and 02.71) we can calculate the Hessian Hn{F) in the stationary 
point: 

i7„(F) = Z-2"[-/'(l) + /(!)], (2.8) 
where / is given by (12. 6 p and r/^ = —Zk/p^ < 0. Rewrite (12. 8p in the form 

n n 

H^{F) = {-Zr'{l - {J2pk)/Z)/I[p, 

k=l k=l 

to see that the relation sgn (i7„(F)) = (—1)" is true. Hence, the corollary is 
proved. □ 

So, we proved the proposition below. 

Proposition 2.1 The mean length and entropy satisfy relations 

L = Y,^ke''''/Z, (2.9) 

k 

^ = -E(^''V^)log(e''V^), (2.10) 

k 

where Z = e^^'' . 

Note that the basic relations (12. 3p , (12. 9 p , and (l2.1Up are obtained by solving a 
new extremal problem. Namely, in the introduced function F the parameter 
A is fixed instead of the length L, which is usually fixed. 
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